71 research outputs found
Certified Algorithms: Worst-Case Analysis and Beyond
In this paper, we introduce the notion of a certified algorithm. Certified algorithms provide worst-case and beyond-worst-case performance guarantees. First, a ?-certified algorithm is also a ?-approximation algorithm - it finds a ?-approximation no matter what the input is. Second, it exactly solves ?-perturbation-resilient instances (?-perturbation-resilient instances model real-life instances). Additionally, certified algorithms have a number of other desirable properties: they solve both maximization and minimization versions of a problem (e.g. Max Cut and Min Uncut), solve weakly perturbation-resilient instances, and solve optimization problems with hard constraints.
In the paper, we define certified algorithms, describe their properties, present a framework for designing certified algorithms, provide examples of certified algorithms for Max Cut/Min Uncut, Minimum Multiway Cut, k-medians and k-means. We also present some negative results
Nonuniform Graph Partitioning with Unrelated Weights
We give a bi-criteria approximation algorithm for the Minimum Nonuniform
Partitioning problem, recently introduced by Krauthgamer, Naor, Schwartz and
Talwar (2014). In this problem, we are given a graph on vertices
and numbers . The goal is to partition the graph into
disjoint sets satisfying so as to
minimize the number of edges cut by the partition. Our algorithm has an
approximation ratio of for general graphs, and an
approximation for graphs with excluded minors. This is an improvement
upon the algorithm of Krauthgamer, Naor, Schwartz and Talwar
(2014). Our approximation ratio matches the best known ratio for the Minimum
(Uniform) -Partitioning problem.
We extend our results to the case of "unrelated weights" and to the case of
"unrelated -dimensional weights". In the former case, different vertices may
have different weights and the weight of a vertex may depend on the set
the vertex is assigned to. In the latter case, each vertex has a
-dimensional weight if is
assigned to . Each set has a -dimensional capacity . The goal is to find a partition such that coordinate-wise
Bilu-Linial Stable Instances of Max Cut and Minimum Multiway Cut
We investigate the notion of stability proposed by Bilu and Linial. We obtain
an exact polynomial-time algorithm for -stable Max Cut instances with
for some absolute constant . Our
algorithm is robust: it never returns an incorrect answer; if the instance is
-stable, it finds the maximum cut, otherwise, it either finds the
maximum cut or certifies that the instance is not -stable. We prove
that there is no robust polynomial-time algorithm for -stable instances
of Max Cut when , where is the best
approximation factor for Sparsest Cut with non-uniform demands.
Our algorithm is based on semidefinite programming. We show that the standard
SDP relaxation for Max Cut (with triangle inequalities) is integral
if , where
is the least distortion with which every point metric space of negative
type embeds into . On the negative side, we show that the SDP
relaxation is not integral when .
Moreover, there is no tractable convex relaxation for -stable instances
of Max Cut when . That suggests that solving
-stable instances with might be difficult or
impossible.
Our results significantly improve previously known results. The best
previously known algorithm for -stable instances of Max Cut required
that (for some ) [Bilu, Daniely, Linial, and
Saks]. No hardness results were known for the problem. Additionally, we present
an algorithm for 4-stable instances of Minimum Multiway Cut. We also study a
relaxed notion of weak stability.Comment: 24 page
How to Play Unique Games against a Semi-Random Adversary
In this paper, we study the average case complexity of the Unique Games
problem. We propose a natural semi-random model, in which a unique game
instance is generated in several steps. First an adversary selects a completely
satisfiable instance of Unique Games, then she chooses an epsilon-fraction of
all edges, and finally replaces ("corrupts") the constraints corresponding to
these edges with new constraints. If all steps are adversarial, the adversary
can obtain any (1-epsilon) satisfiable instance, so then the problem is as hard
as in the worst case. In our semi-random model, one of the steps is random, and
all other steps are adversarial. We show that known algorithms for unique games
(in particular, all algorithms that use the standard SDP relaxation) fail to
solve semi-random instances of Unique Games.
We present an algorithm that with high probability finds a solution
satisfying a (1-delta) fraction of all constraints in semi-random instances (we
require that the average degree of the graph is Omega(log k). To this end, we
consider a new non-standard SDP program for Unique Games, which is not a
relaxation for the problem, and show how to analyze it. We present a new
rounding scheme that simultaneously uses SDP and LP solutions, which we believe
is of independent interest.
Our result holds only for epsilon less than some absolute constant. We prove
that if epsilon > 1/2, then the problem is hard in one of the models, the
result assumes the 2-to-2 conjecture.
Finally, we study semi-random instances of Unique Games that are at most
(1-epsilon) satisfiable. We present an algorithm that with high probability,
distinguishes between the case when the instance is a semi-random instance and
the case when the instance is an (arbitrary) (1-delta) satisfiable instance if
epsilon > c delta
Approximation Algorithms for Hypergraph Small Set Expansion and Small Set Vertex Expansion
The expansion of a hypergraph, a natural extension of the notion of expansion
in graphs, is defined as the minimum over all cuts in the hypergraph of the
ratio of the number of the hyperedges cut to the size of the smaller side of
the cut. We study the Hypergraph Small Set Expansion problem, which, for a
parameter , asks to compute the cut having the least
expansion while having at most fraction of the vertices on the smaller
side of the cut. We present two algorithms. Our first algorithm gives an
approximation. The second algorithm finds
a set with expansion in a --uniform hypergraph with maximum degree
(where is the expansion of the optimal solution).
Using these results, we also obtain algorithms for the Small Set Vertex
Expansion problem: we get an
approximation algorithm and an algorithm that finds a set with vertex expansion
(where is the vertex expansion of the optimal
solution).
For , Hypergraph Small Set Expansion is equivalent to the
hypergraph expansion problem. In this case, our approximation factor of
for expansion in hypergraphs matches the corresponding
approximation factor for expansion in graphs due to ARV
Approximation Algorithms for CSPs
In this survey, we offer an overview of approximation algorithms for constraint satisfaction problems (CSPs) - we describe main results and discuss various techniques used for solving CSPs
A bi-criteria approximation algorithm for Means
We consider the classical -means clustering problem in the setting
bi-criteria approximation, in which an algoithm is allowed to output clusters, and must produce a clustering with cost at most times the
to the cost of the optimal set of clusters. We argue that this approach is
natural in many settings, for which the exact number of clusters is a priori
unknown, or unimportant up to a constant factor. We give new bi-criteria
approximation algorithms, based on linear programming and local search,
respectively, which attain a guarantee depending on the number
of clusters that may be opened. Our gurantee is
always at most and improves rapidly with (for example:
, and ). Moreover, our algorithms have only
polynomial dependence on the dimension of the input data, and so are applicable
in high-dimensional settings
- …